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IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



In re application of: P.H. Westerink, et al 



Date: July 24, 2006 



Serial No. : 



09/892,802 



Filed: 



June 27, 2001 



Docket No. : YOR920010555US1 

COMMISSIONER FOR PATENTS 
Alexandria, VA 22313-1450 

Sir: 

Transmitted herewith is an Appeal Brief in the above-identified 
Application. 

The Commissioner is hereby authorized to charge payment of the 
. following fees associated with this communication or credit any 
overpayment to Deposit Account No. 50-0510. A duplicate copy of this 
sheet is enclosed. 

X $500.00 for filing a brief in support of an appeal 



in accordance with 37 CFR 41.20(b) (2). 

Any additional filing fees required under 37 CFR §1.16. 
Any patent application processing fee under 37 CFR §1.17. 



Respectfully submitted, 
P.H. Westerink, et al 
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PERSON MAKING DEPOSIT: ANNE VACHON DOUGHERTY 




IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



In Re Application of 
P. H. Westerink 
Serial No. 09/892,802 
Filed: June 27, 2001 



July 24, 2006 

Group Art No. : 2176 

Examiner: J. Blackwell 



for IBM Corporation 

Anne Vachon Dougherty 
Title: DYNAMIC SCENE DESCRIPTION 3173 Cedar Road 

EMULATION FOR PLAYBACK OF Yorktown Hts, N.Y. 10598 

AUDIO/VISUAL STREAMS ON A 
SCENE DESCRIPTION BASED PLAYBACK SYSTEM 



Board of Patent Appeals and Interferences 
Alexandria, VA 22313-1450 



APPEAL BRIEF (37 CFR 41.37) 

Appellants hereby appeal to the Board of Patent 
Appeals and Interferences from the decision dated March 24, 
2006 of the Examiner finally rejecting Claims 1-15 in the 
above-identified patent application, and respectfully 
request that the Board of Patent Appeals and Interferences 
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consider the arguments presented herein and reverse the 
Examiner' s rejection. 

I. REAL PARTY IN INTEREST 

The appeal is made on behalf of Appellants, Peter 
Westerink and Stephen Wood, who are real parties in interest 
with respect to the subject patent application. 

II. RELATED APPEALS AND INTERFERENCES 

There are no pending related appeals or interferences 
with respect to the subject patent application. 

III. STATUS OF CLAIMS 

There are fifteen (15) claims pending in the subject 
patent application, numbered 1-15. No claims stand allowed. 
A complete copy of the claims involved in the appeal is 
attached hereto. 
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IV. STATUS OF AMENDMENTS 

There are no unentered amendments filed after final 
rejection for the application. 

V. SUMMARY OF INVENTION 

The present application teaches and claims apparatus, 
a program storage device, and a method for playback of 
multimedia presentations on a playback system, such as an 
MPEG-4 player or a Synchronized Multimedia Integration 
Language (a.k.a., "SMIL") player, that requires scene 
description information to appropriately display a scene. 
The Specification expressly defines the playback information 
from page 1, line 10 through page 2, line 11. Display may 
require preparations, such as opening a data channel or 
setting up buffers, or actions, such as replacing an entire 
scene . 

When a received stream, 201 in Fig. 2, does not include 
the necessary scene description information, as determined 
at simulation block 203, the scene description information 
is automatically and dynamically generated by the player for 
the scenes of the stream in accordance with the subject 
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invention, thereby allowing playback. As taught and 
claimed, a system such as depicted in Fig. 5, determines at 
501 whether the necessary scene description information 
accompanies the incoming stream. If not, generators 502, 
503 and 504 generate the scene description information 
needed by the player to play the streams. 

Appellants point out that it is not simply 
synchronization information to allow synchronized display 
which is generated, but necessary playback information 
without which the player cannot display the streams. 
Appellants note that each of the independent claims 
expressly recites that the generated information is 
generated by the scene description based player/MPEG-4 
player/SMIL player and is "used to permit said player to 
play" the streams/presentation. 



VI. GROUND OF REJECTION TO BE REVIEWED 

The grounds of rejection to be reviewed is that Claims 
1-15 have been rejected under 35 USC 103(a) as being 
unpatentable over U.S. Patent Application Publication No. 
2001/0055476 of Takahashi, et al (hereinafter, "Takahashi") . 

YOR920010555US1 -4- 
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VII. ARGUMENT 

Claims 1, 6, and 7 

Claims 1, 6, and 7 recite a method (Claim 1) , 
apparatus (Claim 6) and program storage device (Claim 7) for 
permitting a scene description based player to play a set of 
elementary streams. As claimed, the player detects if there 
is a scene description stream in a received set of 
elementary streams and, if no scene description stream is 
detected, the player generates a scene description stream 
for displaying the set of elementary streams. 

The Takahashi patent publication is directed to a 
video processing method and apparatus for recording video 
and audio data (see: e.g., steps S423 and S431 of Fig. 4) to 
include access point data and instructions as to whether or 
not to multiplex the video and audio data. By including the 
instruction or flag information about multiplexing, 
unnecessary processing (i.e., multiplexing and 
demultiplexing) can be avoided when it is not needed. 
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Under the Takahashi teachings, either instruction 
information or a flag is provided to a player along with the 
"plural pieces of digital data" (see: paragraph [0012], 
lines 2-4; paragraph [0013], lines 2-4, paragraph [0016], 
lines 4-5, paragraph [0017], lines 2-4, paragraph [0018], 
lines 2-4, paragraph [0019], line 5, paragraph [0020], lines 
4-5, paragraph [0021], lines 6-8, paragraph [0022], lines 7- 
8, paragraph [0023], lines 2-4, paragraph [0024], lines 5-6. 
Therefore, a player always receives both the data for 
display and the instruction/flag information. Takahashi 
does not teach a player and playback method, but teaches a 
recording system and recording method for providing data for 
display along with instruction/flag information. When 
recording data, for example as described in paragraph 
[0039], a determination is made as to whether a scene 
description exists and, if no scene description in inputted, 
"the CPU 11 sets the scene description flag at 0 (S414), and 
generates access information for random access (step S415)." 
Accordingly, Takahashi inserts synchronization information 
when there is no scene description information. What 
Takahashi is doing is recording the video signal to include 
the "video and audio packets . . . together with the management 
information and the access information" (paragraph [0040], 
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lines 7-11) . Any generating of signal processing 

information is being done at the Takahashi video recorder, 
arid not at the player. 

Appellants respectfully assert that the Takahashi 
patent publication neither teaches nor suggests the 
invention as claimed. For all playback under Takahashi a 
player receives an incoming stream comprised of digital data 
and either an instruction or a flag or both. Takahashi 
neither teaches nor suggests that a player receives an 
incoming stream which does not include additional 
information. Takahashi does not teach or suggest that a 
player needs to detect whether an incoming stream has the 
additional information, since Takahashi teaches that a video 
processing system records all video playback signals to 
include both the display data and the instructions/flags. 
Further, Takahashi effectively teaches away from such 
detection at a player, since Takahashi necessarily provides 
a signal with an instruction or a flag. 

Appellants further assert that Takahashi does not 
teach or suggest that a player generates a scene description 
stream. While the Takahashi video recording system may 
record synchronization information (i.e., the access point 
data) for a stream, Takahashi neither teaches nor suggests 

YOR920010555US1 -7- 
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that a video player generates any synchronization 
information, instruction information, or flags. 

Appellants point out that, as taught by the present 
Specification (see: e.g., page 4, " Playback in absence of 
MPEG-4 Systems Components ") , without the scene description 
information, it is not possible for the players to display 
the received streams unless modifications are made to the 
players. It is not simply a question of optimizing display 
by synchronization of audio to visual, it is a question of 
being able to display the audio/visual data at all. As is 
expressly recited in each of the claims, the player 
generates the needed scene description stream which "is used 
to permit said player to play" the audio/visual data 
(emphasis added). It is the scene-description based player, 
and more particularly the MPEG-4 player or the SMIL player, 
that requires the information and that generates the 
required information. All of the claims expressly recite a 
scene description based player, an MPEG-4 player, or an SMIL 
player, which is generating the scene description stream. 

Appellants respectfully conclude that the invention as 
claimed is patentable over the teachings of the Takahashi 
patent publication. It is well established under U.S. 
Patent Law that, for a determination of obviousness, the 

YOR920010555US1 -8- 
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prior art must teach or suggest all of the claim 
limitations. "All words in a claim must be considered in 
judging the patentability of that claim against the prior 
art" (In re Wilson, 424 F. 2d 1382, 1385, 165 U.S.P.Q. 494, 
496 (C.C.P.A. 1970). If the cited references fail to teach 
each and every one of the claim limitations, a prima facie 
case of obviousness has not been established by the 
Examiner. Since the Takahashi publication does not teach or 
suggest a player detecting a lack of scene description 
information or a player generating scene description 
information, it cannot be concluded that the Takahashi 
publication obviates the invention as claimed. 

Claims 2-5 

Claims 2-5, which depend directly or indirectly from 
Claim 1, additionally recite that an MPEG-4 scene 
description/command is generated (Claims 2 and 5), that the 
scene description stream is generated by an MPEG-4 scene 
description generator at the player (Claim 3), and that the 
scene description stream comprises a plurality of MPEG-4 
scene description commands (Claim 4) . Appellants rely on 
the arguments presented above with regard to the teachings 
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of Takahashi and further assert that Takahashi neither 
teaches nor suggests that a player generates MPEG-4 scene 
descriptions/commands or has an MPEG-4 scene description 
generator. Takahashi teaches generating any scene 

synchronization/description information at the recorder and 
not at the playback component. 

Claim 8 

Claim 8 is directed to a method of using an MPEG-4 
player to playback a presentation that contains only audio 
visual streams. Claim 8 expressly recites steps for an 
MPEG-4 player comprising constructing a scene graph with 
nodes for rendering visual and audio, encoding the scene 
graph in a scene replacement command, constructing and 
encoding an object descriptor update message, constructing 
an initial object descriptor, and providing all of the 
foregoing for playing received streams. Again, Appellants 
rely on the arguments set forth above with regard to the 
teachings of Takahashi. Appellants further reiterate that 
the Takahashi patent publication does not teach that a 
player receives only audio and visual streams, but teaches 
that the video recorder always includes at least a flag 
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indicator if not also a scene descriptor. Further, 
Takahashi does not teach or suggest an MPEG-4 player with 
the capability of generating/constructing the scene 
information as claimed. Takahashi teaches that a video 
recording unit generates scene description and/or 
multiplexing flag information. 

Claims 9-12 

Claim 9 and Claims 10-12 which depend therefrom are 
directed to a method for permitting an MPEG-4 player to play 
a set of elementary streams having no MPEG-4 system streams. 
As claimed, the MPEG-4 player detects if there is an MPEG-4 
system stream and, if not, generates an MPEG-4 system stream 
to permit playback of received elementary streams. In 
addition to the arguments presented above, Appellants note 
that Takahashi does not teach a method for an MPEG-4 player 
to generate an MPEG-4 system stream. 



Claims 13-15 



Claims 13-15 recite a method (Claim 13), an apparatus 
(Claim 14) and a program storage device (Claim 15) for 
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permitting an SMIL based player to play a set of elementary 
streams having no SMIL document. In addition to the 
arguments presented above, Appellants note that Takahashi 
does not teach a method for an SMIL player to generate an 
SMIL system stream. 
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CONCLUSION 

Appellants respectfully assert that the Examiner has 
erred in rejecting Claims 1-15 as unpatentable over the 
teachings of the Takahashi patent publication. "All words 
in a claim must be considered in judging the patentability 
of that claim against the prior art" (In re Wilson, 424 F. 
2d 1382, 1385, 165 U.S.P.Q. 494, 496 (C.C.P.A. 1970). If 
the cited references fail to teach each and every one of the 
claim limitations, a prima facie case of obviousness has not 
been established by the Examiner. Since the Takahashi 
patent document fails to teach a player, method for a 
player, or program storage device for a player to perform a 
method for generating scene description information 
necessary to permit playback, it cannot be maintained that 
Takahashi obviates the claimed invention. Appellants 
request that the decision of the Examiner, rejecting all of 
the pending claims, be overturned by the Board and that the 
claims be passed to issuance. 

Respectfully submitted, 
P.H. Westerink, et al 



By: {X^^yf/o^Jir^ 
Anne Vachon Douqhdi 



Anne Vachon Dougherty 
Registration No. 30,374 
Tel. (914) 962-5910 
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APPENDIX OF CLAIMS 

1. A method of permitting a scene description based player 
to play a set of elementary streams having no scene 
description, said method comprising: 

said player detecting if there is a scene description stream 
in a set of elementary streams, said scene description 
stream providing information on the position and 
interrelationship of audio visual objects in a scene; and 

if no scene description stream is detected, said player 
generating a scene description stream for displaying said 
set of elementary streams, wherein said scene description 
stream is used to permit said player to play said set of 
elementary streams. 

2. A method as recited in claim 1, wherein, said set of 
multimedia streams comprises at least one of a single audio 
stream and a single visual stream, said generating a scene 
description stream comprises constructing an MPEG-4 scene 
replacement command with an MPEG-4 scene graph having nodes 
for rendering said audio and/or visual streams, generating 

YOR920010555US1 -14- 
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an object descriptor stream by constructing MPEG-4 object 
descriptor update commands, and constructing an MPEG-4 
initial object descriptor for describing said object 
descriptor stream and a scene description stream. 

3. A method as recited in claim 1, wherein said scene 
description stream is generated by an MPEG-4 scene 
description generator. 

4. A method as recited in claim 1, wherein said scene 
description stream comprises a plurality of MPEG-4 scene 
description stream commands. 

5. A method as recited in claim 2, wherein said plurality of 
commands comprises at least one of the following commands: 

a scene replacement command, a node insertion command, and a 
node deletion command. 



6. An apparatus for permitting a scene description based 
player to play a set of elementary streams having no scene 
description stream, said apparatus comprising: 

a scene description detector at said player for detecting 
YOR920010555US1 -15- 
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in a received set of elementary streams whether there is 
a description stream providing information on the position 
and interrelationship of audio visual objects in a scene; 
and 



a scene description stream generator at said player for 
generating a scene description stream for displaying said 
set of elementary streams when no scene description stream 
is detected, wherein said scene description stream is used 
to permit said player to play said set of elementary 
streams . 



7. A program storage device readable by a machine, tangibly 
embodying a program of instructions executable by the 
machine to perform method steps for permitting a scene 
description based player to play a set of elementary streams 
having no scene description stream, said method comprising: 

detecting at said player if there is an scene description 
stream in a set of received elementary streams, said scene 
description stream providing information on the position and 
interrelationship of audio visual objects in a scene; and 
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if no scene description stream is detected, said player 
generating a scene description stream for displaying said 
set of elementary streams, wherein said scene description 
stream is used to permit said player to play said set of 
elementary streams. 

8. A method of using an MPEG-4 player to playback a 
presentation that contains only audio visual streams, said 
method comprising the steps for said player of: 

constructing a scene graph with nodes for rendering visual 
and audio for a presentation with visual and audio; 

encoding said scene graph in a scene replacement command; 

constructing object descriptor update messages for said 
visual and audio; 

encoding said object descriptor update messages to generate 
an object descriptor stream; 

constructing an initial object descriptor which describes 
said object descriptor and scene description streams; and 

YOR920010555US1 -17- 
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supplying said initial object descriptor, said object 
descriptor stream and said scene description stream to said 
MPEG-4 player to permit playback of said presentation. 

9. A method of permitting a MPEG-4 systems based player to 
play a set of elementary streams having no MPEG-4 systems 
streams, said method comprising the steps for said player 
of: 

detecting if there is an MPEG-4 system stream, said MPEG-4 
system stream providing information on the position and 
interrelationship of audio visual objects in a scene; and 

if no MPEG-4 system stream is detected, generating an 
initial object descriptor, a scene description stream, and 
an object descriptor stream for displaying said set of 
elementary streams, wherein said initial object descriptor, 
said scene description stream, and said object descriptor 
stream are used to permit said player to play said set of 
elementary streams. 
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*h h aS recited in claim 9, wherein said MPEG-4 

10. A method as reci^eu 

* ffl is detected by checking for the presence of an 
system stream is detecteu 

initial object descriptor stream. 

U A method as recited in claim 9, wherein said MPEG-4 
system stream is detected by checking for the presence of a 
scene description scene stream. 

12 a method as recited in claim 9, wherein said MPEG-4 
system stream is detected by checking for the presence of an 
object descriptor stream. 

13. A method of permitting a Synchronized Multimedia 
mtegration Language (SMIL) based player to play a set of 
elementary streams having no SMIL document, said method 

comprising: 

said player detecting if there is an SMIL document, 

said SMIL document providing information on the position and 

interrelationship of audio visual objects in a scene; and 

if no SMIL document is detected, said player generating 
an SMIL document, where said SMIL document is used to 
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permit said player to play said set of elementary streams. 

14. An apparatus for permitting an SMIL based player to play 
a set of elementary streams having no SMIL document, said 
apparatus comprising : 

an SMIL document detector at said player for detecting if 
there is an SMIL document, said SMIL document providing 
information on the position and interrelationship of audio 
visual objects in a scene; and 

an SMIL document generator at said player for generating an 
SMIL document if no SMIL document is detected, where said 
SMIL document is used to permit said player to play said set 
of elementary streams. 

15. A program storage device readable by a machine, 
tangibly embodying a program of instructions executable by 
the machine to perform method steps for permitting a scene 
description based player to play a set of elementary 
streams having no scene description stream, said method 
comprising: 
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said player detecting if there is a Synchronized Multimedia 
Integration Language (SMIL) document, said SMIL document 
providing information on the position and interrelationship 
of audio visual objects in a scene; and 

if no SMIL document is detected, said player generating 
an SMIL document, where said SHIL document is used to 
permit said player to play said set of elementary streams. 
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EVIDENCE APPENDIX 



There has been no additional evidence presented, 
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RELATED PROCEEDINGS APPENDIX 

There are no related proceedings. 
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